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A survey of students was conducted" to determine the extent of 
knowledge about and usage of the first Educatiotu^l Assessment Center 
publication of Student Ratings data for ^student use. A total of 375 
^^tudenta were interviewed during registration. Winter Quarter, 1975. 
Results showed thaft about SO percent of the students* were aware of 
the publication, 29 trfed to make use of the information, and only 
9 percent found the information liseful. Reasons were given for the 
relative ineffectiveness of the first publication. 
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^ A Survey of tie Availability and Usage - of Published 

V, Student* Ratings Results' 
Uarsali Hansen and Gerald H, GlUaore 

The Educational Assesanent Center (EAC) in revising the current Faculty 
Evaluation Poms oade a iajor chang^ by designing the last seven iteaa to 
provide InforMtion to students as well as to the instructor of the (SJourse 
(GlUaore, Note 1) . The najor reason for making these ratings available 
1 -vas as an aid to future course selection. By written consent over 50Z of 
the faculty using the forms agreed to have the results of these Iteas 
published Pall Quarter of 1974, the first quarter of use of the Instructional 
Assessaent Systea. It was to the problem of an effective aethod of publica- 
tion that the fo^owlng survey was addressed. 

Due to the tlpe llnltatlon placed on the Center by the quarter system, 
soae Immediate yet inoffensive method ^f publication was needed. A reason* 
able goal seeaed to be to have ratings published prior to the pre-reglstratlon 
of the following quarter. After such deliberation it was decided that for 
the sake of ej^edlency the initial publication would be in the form of a 
booklet produced entirely at the 6xpense of the Center (Gillmore, Note 2). 
The results of the Individual professors' ratings within the booklet were 
placed alphabetically by department and in numerical order by class nuiAer. 

The ratings were presented in the form^ of perc«ttage- dlst r l b utl o n wliL no 

coaparative or normative information Included. Approximately 1500 booklets 
were distributed to the locations on the official advising list and to 
locations arbitrarily decided upon by the Center as conmonly frequented by 
students (libraries, information center, etc.). Three advertisements were 
placed in the caaq>us tjp^pa^r (The Dally) by meabeza of the Associated 
Students of the Onlversitgr of Washington TASK PORCE, who assisted in the , 
project. Individual copies were not available to students; the copies * / 
placed in the aforementioned locations were restricted to use in that aria. 

The following survey was conducted to detetmln* the effectiveness of 
the above method of dletrlbutlon In makisrg the information accessible to 
fbB students for whom it waa intended. 




Method * . 

Sample « .'^ 

■ - T • 
The population surveyed consisted of students registering for Spring 

Quarter in Scbaltz Hall, the lar^r of two registration locations on c^ipus. 
Registration at the University of Washington lasts 8 days with students 
from different classes registering c»n different days. (See Appendix copy 
of Registration Schedule.) The survey was conducted the last 6 <iays of 
registration. It was decided in advance that no fewer than 50 students 
were to be surveyed on each day. 

The surveyors consisted of three EAC office employees and two members 
of the ASDW TASK FORCE. All surveyors were students themselves and aware 
of the purpose of the^ survey as well as the survey method. The instructions 
were to approach the student within closest proximity to a given location 
and conduct the survey, from thtfpe proceeding to the next student. At" times 
two interviewers were present in the registration area. Copies of the pub- 
lication were present in the registration area. The surveyots alio dis- 
played a copy of the booklet to the student upon initiation of the survey. ' 

The survey guide consisted of three avenues- of questioning. (See 
Appendix II. for the instrument used by the interviewers.) Initially the 
interviewer asked four questions: year in school," iajor, awareness of the 
publication, and whether or not an adviser had been seen tfiis quarter: If 
the student was aiot aware of the publ^atlon the Interviewer followed one 
line of questioning, the next question being does the student regularly 
read the Dally ( the campus newspaper). The interviewer then asked the 
student whether, had he known the. ratings were availabe, he would have 
consulted them. ■ If the response was negative the student was asked why not. 
All students were asked the final question, for "suggestions on making the 
booklet or material therein more accessible to them or other students. 

If the student responded positively to the aforementioned question 
concerning his knowledge of the publication he was then asked if he had 
tried to make use of it. If a negative response Was obtained to the ques- 
tion he was asked not and thgn asked regularly read the caajpua 
newspaper. If a pol^ltlve response was obtained to the question concerning 



\ 



ERIC ^ 



5 



' 3 

the use of the publication the student was' asked where he had used- it. He 
then was asked if he 'had found the pub'llcation useful. If the'response was 
negative he was asked why not. If it was positive he was asked if it actu- 
ally influenced his choice in courses. If the response to this, question was ■ 
positive the student was asked how the- tatings had influenced his choices. 
All students who had actually used the ratings were asked how the informa- 
tion wJ^thin the booklet could be presented as to be of more use. *■ 

If a student being interviewed had any questions concerning ratings, 
the booklet or the survey^, the interviewers were instructed to reply. 
Limited variation on the wording of* the questions, though not on the content 
or the order in which they were presented, was permitted. 

Results *^ 

The sample of students interviewed consisted of 28 freshmen, 42 
sophomores, 91 juniors, 96 seniors, 45 fifth year siudents^^and 7r graduate 
students. The total number 'of studenits interviewed was"^?^ Table 1 shows 
the number and percentage of students who indicated their dwaxeness of the 
publication. ' '^"^^v, 

Table 1 ^ 

Students Who Responded Positively to th^ Question "Were You Aware that 
Student Ratings Were Available 'for Your Use?" 





Fresh Soph 


Junior 


Senior 


5th 


Grad Total 


Number ^ 


5 ; 24 


59 


43 


23 


37 191 


% of -students 












suveyed 


. 18 58 


54 


45 




51 50 


As was mentioned in the method. 


the suin^ey 


followed 


in two 


directions 



this first question. The resulCs are presented following the sanwy^irection 
as tlie survey with the exception of the questions concerning accesVibllity 
of the- information within the publication. This material is presented as- 
a unit -fbllow^g the presentation of the 'directional questions. 



Table^2 folldws the direction formed by. the positive response to the 
question presented in Table 1. The number of students responding positively 
to the second qiaestion of "Have' you tried to make use of the publication of 
student ratings?" are shown. This J:able also shows the percentage these 
students are of the total number of students responding to the survey.* In 
addition, in this table are the percentages of the students relative to ^ 
only tho8.e who responded positively to the first question in Table 1. 
. . ' • i 

' • * V - 2 , 

Students Who Responded Positively ito the Question "Have You Tried 
to Make Use of the Publication of Student Ratings?" 





Fresh 


Soph 


Junior 


Senior 


5 th 


Grad 


Total 


Number 


2 


7 


23 


13 


5 


6 


57 


Z of students 
surveyed 


7 ' 


16 


11 


* 

X3 


11 


8 ' 


15 


Z of students 
responding 
positively to 
question on 
TabJ.c 1 


' 40 


29 


39 


• 

30 


• 

21 


10 


29 



Table 3 shows the reasons given by those students who responded ~ 
engatively to the question in Table 2 for not using the publication. Note: 
this is following the direction of a positive response to the first ques- 
tion, i.e., these students were aware of the existence of the publication. 



, Table 3 

Response to the Question "Having Known, the Ratings Were Available 

Ifliy Did You Not Use Them?" 



Fresh Soph Junior Senior 5th Grad Total 



Responses 

Inaccessible 
Lack of time 
Preplanned program 
Foreknowledge of 

classes and profs 
No in tires t 



2 
1 



4 
3 



2 

5 



4 
3 

4 

5 
7 



8 
3 



9 
1 



1 

13 

10 
4 



19 
7 
24 

.34 
21 
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Those students presented in Table 2 were then asked "Were the ratings 
useful?" T^e positive responses are shown in Table 4. Again just the 
nuisber of responses is presented, then this ntimber expressed as a percentage 
of the entire sample surveyed and lastly as a percentage of those responding 
positiv^ly^ to the questiqn on their awareness of the publication. 



Table 4 

Positive Responses to the Question "Were the Ratings Useful?^* 

Fresh Soph Junior Senior 5th Grad Total 

Number ,1 2 5 4^ 2 4 18 

Z of students ^ 

surveyed 3 4 5 4* 45 4 

% of students 
responding 
positively to 
question on 

Table 1 20 8 8 9 8 10 
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The reasons of those students whQ responded negatively to the question 
••Were the ratings useful?" are presented in Table 5* These are students \ 
yho were aware of the publication and did use it. 



, , ' Table 5 
Responses to Question J'Why Didn't, You Find the Publication Useful?" 

' ^ Fresh Soph ^^unior Senior 5th ' Grad ' Total 

Not enough courses ' i 

and professors 3 14 6 1 2 ' 26 

Required courses ^2 2 4 

Wrong infbrmation , ,1 l 

Table 6 shows from the students responding positively to the question 
"Did you find the ratings useful?" the number of stude^^s whose course 
selection was actually influenced by them* Again the second figures show 
the percentages the students atfe of the total and the third figures show 
the percentages the students are of those responding positively to the 
first question. 

8 



Table 6 J 
Positive Responses to the Question "Did the Ratings Actually 
Influence Any of Your Choices?" ' 

Fresh Soph Junio r S enio r 5 th Grad To tal 

Number 1 2 ,1 1 5 

% of students ^ 

surveyed 2 2 2, 1 1 

% of total V)sitive « 
.response to first 

question 4 4^ 4 2 2 

' Table 7 is the first table in the second direction pursued by the 
survey. In actuality this table is merely the reverse of Table 1, since 
it presents the number of negative res^cfases to the question concerning 
awareness of publication* 

Table 7 

Negative Responses to the Question "Were You Awaj:e that Student 
Ratings Were Available for Your Use?" 

Fresh Soph Junior Senior 5th Grad Total 

Number 23 18 42 ' 53 . " 17 36 189 
% of total students 

surveyed 82 42 • 46 ' 55 34 49 50 

Continuing in the direction created by the negative response to the 
question of awareness. Table 8 shows the number of students who would have 
wanted to consult the ratings had they been aware of their publication. As 
in the other tables, the second row of figures is the percentage the stu*- 
dents are of all students surveyed and the third row is the percentage 
these students are of those responding negatively to the question on 
awareness of publication. 



Table 8 

Positive Responses to the Question "Had You Known the Ratings 
Were Available, Do You Feel You Would Have Wanted io 
Consult Them Before Making Your Course Selection?*' 





Fresh 


Soph 


Junior 


Senior 


5th 


Grad 


Total 


Number 


20. 


18 


35 


. 34 


14 


18 


139 


% of students 






M 

* 










surveyed 


71 


42 


38 


35 


31 


24 


37 


\L of students 
-Responding 
















86 


100 


83 


64 


82 


50 


78 




Table 9 shows the reasons given\by ^tsljase students responding negatively 
to both the questions presented in Tabin. 7 and Table 8 for not wanting to 
consult the ratings had xhey known of t^^^ availability . 

Table '9 

Responses to Questioh "IThy Wouldn't You Use the Ratings If You 
Had Known They Were Available?" 



Fresh Soph Junior Senior 



5 th 



Response 
Preplanned program 
Word of mouth 
No interest 



1 

1 



3 
2 

K 4 



8 
1 

8 



Grad 

6 

2 
5 



Total 



The last tales concern the questions related to accessibility and 
presentation of the information within the publication • The first such 
table. Table 10, shows the response to the question concerning location of 
the publication: "IThere did you use the publication?" Note, the students / 
asked this question were only those responding positively to both the 
question concerning awareness of the publication and the question concerning 
use» ^ P 
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Table 10 

Responses to the Question "Where Did You Use the Publication?" 



Fresh 


Soph 


Junior 


, Senidif 


5th 


Grad 


iotal 


Schmitz (Admissions) 1 


4 


15 


7 


2 


4 


33 


Hub (Student Union 














B.ulldlng) 


1 


•4 




2 




7 


Advising Offices 


2 


•2 


3 


• 1 


2 


10 


Library 


1 


3 


1 






5 



All students were asked if they saw an adviser for course selection* 
The nt^er of students responding positively and the percentage that this 
number is of the entire sample is presented in Table 11. 

Table 11 

- Positive Response's to the Question "Djd You* See an Adviser 

for Course Seleption?" 





^ Fresh 


Soph 


Junior 


Senior 


5th 


Grad 


Total 


Number 


10 


18 


25 


20 


11 


28 


112 


% of students 














* 


surveyed 


* 35 


42 ^ 


27 


20 


24 


38 


29 



&a^ 



Both students who responded negatively to the question concerning 
awareness of the publication and stud^ts responding negatively to the 
question concerning use of the publication were asked if they regularly rea 
the Daily . The number of these, students responding positively, the percent- 
age this number is. of all students surveyed, and the percentage this number 
is of students asked this- question are presented in Table 12. 

The last two tables concern the' publication itself. Table 13 shows the 
responses of students to the question "How could the presentation 'of the 
information within the publication be improve^?*' This question was asked of 
those students responding positively 'to the question ''Have you tried to make 
use of the publication of Student Ratings?" Table. 14 sh6ws the response of 
students to the question "How couW the distribution of the information 
within the publication be improved?'' This question was asked of all students 
Surveyed* 
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Table 12 

Negative Responses to the Question "Do You Regularly Read the Daily? "^ 





Fresh 


Soph 


Junior 


Senior 


^ 5th 


Grad 


Total 


* 

Number ^ 


17 


26 


40 


, 56 


' 17 


39 


' 195 


Z of' students surveyed 


. 60 


61 


43 


58 ' 


37 • 


53 


52 


% of students asked 
















question 


65 


♦ 74 « 


60 


. 70 


50 


60 


63 



Obly includes 'students who did not use the publication. ^ 



Table 13 ' • ' 

Responses to the Question "How Could the Presentation 'of 
Information Be Improved?" 



Response 

Fine as is 

More professors 

Increase amount 
published 

Publish course 
. description 



Fresh Soph Junior Senior 5th Grad Total 



2 
2 



13 
4 

1 

1 



2 
2 

3 

1 



1 ' 

1 ; 

2 
1 



Table 14 

Responses to the Question "How Could We Improve the Distribution of the 
. Information Contained within the Publication?" 





Fresh 


^Soph 


Junior 


Senior 


5 th 


jQrad 


Total 


Response 




• 












More publicity 


1 


6 


12 


17 ' 


2 


4 


42 


Posters 


2 


- 2 


3 


13 


1 


8 


29 


Put in ^ the Daily 


2 


4 


9 




• 1 


- 4 


20 


Put in the Time Schedule 


4 


2 


2 


2 


1 


4 


15 


Individual copies 


2 


1> 


4 


7' 


1 


4 


19 * 

< * 


Newspaper articles . 


1 


/ 




1 • 




1 


3 


Seli it 




1 


1 


• 2 




2 


6 


Put in more palaces 


1 


2 


1 . 


4 


5 


4 


17 
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X ^ Discussion 

' Through -the administration of a survey to 375 students at the time 

of registration, the EAC attempted to obtain student opinion <^n. several 

questions concerning the publication of faculty ratings for student use. 

The Issues in question were: did the atiicients think th^re vfes actually a ^ 

# ' J- » • 

need for the publication of the information, was t^e EAC meeting the need 

• * . ' • 

with their publication, and if not, what exactly was ineffective. ^ 

The results of the survey show that only 50% of the students interviewed 
\?ere aware of the survey. Of the 50% who. were .unaware, however, 86% of , the * 
freshmen, 100% of the sophomores, ^3% of tfi^ juniors and actually 78% of the 
, total atudents who were unaware would have liked to have used the publica- 
tion. . Of those students who were aware of the publication, 29% actually 
tried to use it. Of those who knei^ of the publication but failed to use it, 
the primary reasons given By the utiderclassmen were its inaccessibility and 
their own lack of time. The primary reasons given by the upperclassmen and 
graduate' students were the inflexibility of their tojm schedules to accommo- 
date such information and their foreknowledge of professors, and classes. 
From, thes^ results, then, it appears that students do want the information 
pvwlded by the publication, but that the need-appear-e strongest among the 
underclassmen. , « 

As to the questiion of whether the publication provided by the EAC 
met'tne needs of the students, only 9% of the students who were aware of 
the ratings found them useful, 20% of whom were freshmen, and only 2% of 
the students were actually influenced by the ratings. It appears then that 
the publication of the data from Fall Quarter, 1974, was ineffective. 

The primary jeason gi^en by students for its ineffectiveness was th4 
relatively small number of courses listed. The response t6 the questior^ ' 
"How could the information be presented more effectively?" generally^ indi- 
cated the publication was fine with the exception of not enough classes had 
results published. 

The other cause for the ineffectiveness of the publication indicated 
by the survey was the location and publicity of its existence. Though 29% 
of the students surveyed saw an adviser for course selection (112 students), 
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oxdy 10 indicated they had u^ed the publication in the advising office. 
Vo0t students ^o used the publication used it at Schmltz Hall, the location 
of registration. It appear^- then, that the advising centers were not the. 
most effective locations for the use of the publication. 

Since 50Z of the student:s surveyed were totally unaware of the 
publication, publicity, was dcifinitely a problem. As was, mentioned in the 
Introduction, 3 half-page advertisements were placed in the Daily . How- 
ever, 62Z of those, students who had been either unaware of the publication 
or had been avjare and not us^d it, do regularly reed tihe Daily , This 
publicity apparently was not | sufficient to inform the students of the 
publication. « j 

,5aj(^r problems presented by the survey for the future of- the 
V publication are to b,etter inform the students of its existence and location, 
and to present more material within the publication. The problem of an 
effective method of presentation was asked of all the students surveyed. 
The majority of students felt more publicity was needed, or posters. A 
sufficient number of students suggested the ratings be put in the Daily 
or in the Time Schedule. A ntrinbe? suggested individual copies. All these 
suggestions are presently under consideration by the EAC. 

• As to the problem of the material within the publication, as was 
mentioned in the introduction, 55% of the professors rated had their ratings 
published. At the present time probably less than 50% of the courses 
offered are currently being surveyed. . This is the first quarter the ratings 
were published and many courses offered in the fall are not 'offered in the 
spring. Therefore, the dissatisfaction of the students that' the course or 
courses they were looking fpr^re not in. the publication was probably 
valid, even though in all the booklet contained information on over 800 
'courses. Very few courses are taught by the same professor two quarters in 
a row. Subsequent quarters, data from more courses will be available. 
However, .the only manner in which a professor's ratings are published is 
with his consent. Publication is not mandatory. Therefore the EAC has no ■ 
solution^ short of faculty senate action for the problem of the extensiveness 
of the publication in supplying the needed information. 
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It does appear , based upon one survey of 375 students, that the 
Ifi^OTation as it is presented is desired by the students. However, two 
obstacles black the effectiveness of the publication, the first being dis- 
tribution and the second being quantity' of information being presented* 
Inq)ortantly, howeyer, it should be emphasized that this survey was taken 
after the first term of use of the Instructional Assessment System, The 
extent to which ma^y of the problems discussed above will be ameliorated 
with the passage of titae is still an open question. Future surveys, simi- 
lar to this, will be undertaken to make this determination. 
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^pendlx I 
Preregfj^tration Schedule 



Freshmeigt 

Seniors 

Graduates 

Fifth year 

Juniors 

Sophomores 



February 19 
February 20 
Febrtjary 21 
February 24 
February 25 
Febtxiary 26 



4 



16 
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